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Another important problem of implementation is the lack of integrity ir the delivery of treatment. The panel discovered many discrepancies between what was supposed to have been tested and what actually was done, The findings of an experiment with an exemplary design will be misleading if treatment is not described, inadequately described, or not delivered as described. Since each of these situations occurs frequently, it is uncertain just what has ever been given a fair trial.
Other problems in assessing the effectiveness of rehabilitative techniques revolve around methodological issues, including those of evaluation and measurement. To determine whether rehabilitation services were effective requires the careful evaluation of programs and their elements. This, in turn, requires systematic planning and testing of various interventions through deliberate experiments. Since program outcomes often have been unanticipated, one cannot be certain of the effect of a program without a true experiment. Because other methods cannot yield findings that provide the degree of certainty of knowledge, the panel strongly recommended the use of true experiments whenever possible. True experiments in offender treatment are currently conspicuously rare. Although financial, legal, and ethical objections to social experimentation are often raised, guidelines regarding voluntary consent and adherence to the principle of avoiding harm to participants can offer protection, whereas the long-term costs of continuing programs without accumulating knowledge about their outcomes doom society to repeating errors and the inability to replicate successes.
In addition to being characterized by inadequate research designs, most studies have sample sizes so small that it is impossible to detect subtle treatment effects and inadequate specification of intervening variables, making the separation of treatment effects from other elements impossible. The outcome measures used to evaluate the effectiveness of a treatment are often unsatisfactory. The traditional measure of effectiveness, recidivism, not only lacks a common definition but is of limited sensitivity when regarded as an all-or-nothing outcome, as is the common practice. Efforts to assess criminal activity as a multicategory or continuous variable, while not perfect, are being developed and should continue to be used, and, in the interim, the use of multiple measures of recidivism is encouraged.
A final set of problems in rehabilitation research examined by the panel involves legal and ethical issues. How much and what type of persuasion to convince offenders to participate in programs is ethically permissible? How much is actually used? Other questions arise out of the special conditions required for successful experimentation. Constraints on evaluations of treatments arise primarily from threats to four basic principles: due